Image pickup apparatus, photographing method, and storage medium recording photographing method

ABSTRACT

Two sets of image data are combined into one set of image data producing no unnatural feeling with a simple procedure. A direction for each set of image data is designated on a touch panel ( 26 ). The directions of the image data are compared, and a tilt of one of the sets of image data is adjusted relative to the other set of image data based on the result of the comparison. The adjusted image data and the other image data are combined into one set of image data producing a natural feeling.

TECHNICAL FIELD

The present invention relates to an image pickup apparatus, aphotographing method, and a storage medium recording the photographingmethod.

BACKGROUND ART

Image data obtained or to be obtained with a digital still camera isdifferent from a photograph taken with a conventional silver-filmcamera. Various digital image processes may be applied to the image dataof the digital still camera.

For example, according to one of the digital image processes, or one ofthe functions of the digital still camera, the image data obtained withthe digital still camera is processed as follows. A first photograph ofa fixed subject A and a person B is taken with a picture compositionwhich includes the fixed subject A at the center of a frame FL and theperson B at a right side of the frame FL, as shown in FIG. 9A.

A second photograph of subjects C and A is taken with a picturecomposition similar to the first photograph, which includes the subjectC at the left side of the frame FL as shown in FIG. 9B.

When the second photograph is taken, the image of the first photographis displayed on a liquid crystal display panel of the digital camera,more specifically, the image of the fixed subject A and the person B inthe first photograph shown in FIG. 9A is displayed in a right two-thirdsarea of the frame FL of the liquid crystal display panel in asemi-transparent state. Therefore, if the second photograph is takenwith the current subject A overlapping precisely with the subject A ofthe first photograph, second image data shown in FIG. 9B is obtained,which is used to be combined with the first image data shown in FIG. 9A,providing image data as shown in FIG. 9C. The combination of the firstand the second image data obtained as set forth above produces aresultant image data, which shows the subjects A and C, as if they arephotographed together although actually they are photographedseparately.

Since the digital camera has the image composing function set forthabove, image data of two persons B and C shown in FIG. 9C may beobtained by photographing the persons B and C separately and combiningthe separately obtained image data of the persons B and C without usinga tripod and a self timer function or without asking other person totake their picture.

To obtain the same image quality as the first photograph, the secondphotograph must be taken under substantially the same photographingconditions for the first photograph, such as the zoom position of a zoomlens, exposure conditions including focus and shutter speed, whitebalance, and flash setting.

In the above mentioned image composing procedure, two sets of image dataare combined, but an arbitrary number of sets of image data may becombined in a similar manner.

Regarding the image composing technique, there has been proposed atechnique of combining image data and other image data including aseries of characters, in which a tilt of the characters are correctedprior to be combined with the former image data. (Refer to Japaneselaid-open patent application No. H8-065457)

Further, another image composing technique has been proposed, in whichimage data captured with plural cameras installed on a moving body andthe image data are corrected based on angles and a movement detectedfrom the moving body prior to being subjected to the combinationprocess. (Refer to Japanese laid-open patent application No.2001-245131)

However, in the conventional technique described with reference to FIGS.9A, 9B, 9C and 9D, image data are acquired with an unfixed cameraseparately by separate persons, and therefore the image data can beacquired with a slightly changed camera angle. If these image data arecombined, the resultant image data will produce an unnatural feelingcompared with image data which is obtained by photographing two personstogether.

FIG. 9D is a view showing a sample of the combined image data, in whichthe subject C of the second image data has a tilt to the left comparedwith the subjects A and B in the first image data. This is caused by thetilted camera angle of the camera at which the second photograph istaken.

The technique disclosed in Japanese laid-open patent application No.H8-065457 can not be used for the correcting the camera angle, becausethis technique is for correcting the tile of the series of characters.

The technique disclosed in Japanese laid-open patent application No.2001-245131 is for detecting a tilt of a camera using a gyroscope tocompose image data and may be used for a moving body such as anautomobile and a train, but it is not practical to use the technique fora compact device such as a digital camera and a cellular phone.

DISCLOSURE OF INVENTION

According one aspect of the invention, there is provided an image pickupapparatus which is provided with storage for storing first image dataand second image data obtained respectively in a first photographingoperation and a second photographing operation, a firstdirection-designating unit for designating a direction for the firstimage data stored in the storage, a second direction-designating unitfor designating a direction for the second image data stored in thestorage, a direction-comparing unit for comparing the directionsdesignated respectively for the first image data and the second imagedata by the first and the second direction-designating unit, animage-angle correcting unit for adjusting a tilt of either of the firstand the second image data depending on a result of the comparison madeby the direction-comparing unit so that the direction of the adjustedimage data coincides with the direction of the other image data, and animage composing unit for combining the image data adjusted by theimage-angle correcting unit and the other image data.

BRIEF DESCRIPTION OF DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate presently preferred embodiments ofthe invention, and together with the general description given above andthe detailed description of the preferred embodiments given below, serveto explain the principles and the scope of the invention.

FIG. 1 is a view illustrating a perspective external view of a digitalstill camera according to a first embodiment of the invention;

FIG. 2 is a block diagram showing a circuit configuration of the digitalcamera according to the first embodiment of the invention;

FIG. 3 is a flowchart showing a procedure in a couple photographing modein the first embodiment;

FIGS. 4A, 4B, 4C, 4D, 4E and 4F are views illustrating by way of exampleimages displayed on a display screen in the couple photographing mode inthe first embodiment;

FIG. 5 is a view illustrating a combined image in the couplephotographing mode in the first embodiment;

FIG. 6 is a flowchart showing a procedure in a couple photographing modein a second embodiment of the invention;

FIG. 7 is a flowchart showing a procedure in a couple photographing modein a third embodiment;

FIG. 8 is a flowchart showing a procedure in a couple photographing modein a third embodiment; and

FIGS. 9A, 9B, 9C and 9D are views illustrating an example of aconventional image combining function.

Best Mode for Carrying Out the Invention

First Embodiment of the Invention

A digital still camera (hereafter, “digital camera”) according to afirst embodiment of the present invention will be described withreference to the accompanying drawings.

FIG. 1 is a view illustrating an external perspective view of thedigital camera 1 as seen from its rear side. The digital camera 1 isprovided with a monitoring display unit 2, a cross key 3, a decision key4 and an optical viewfinder 5 on its rear face, as shown in FIG. 1.

The monitoring display unit 2 comprises a liquid crystal display panelwith a back light, and has a function as an electronic viewfinder formonitoring an image to be photographed in a photographing mode, and afunction as a display for reproducing a recorded and selected image datain a reproducing mode.

Further the monitoring display unit 2 has a function as a touch panelfor obtaining a position coordinates representing a position where auser touches with his/her finger and is also used to give variousinstructions with respect to the image displayed thereon.

The cross key 3 comprises a key unit, in which an upward-direction key,a downward-direction key, a leftward-direction key and arightward-direction key are integrally combined, and has the decisionkey 4 at the center portion. The cross key 3 is used to select and/orupdate various items and the decision key is manipulated to finallydecide to perform the item selected with the cross key 3.

The optical viewfinder 5 is used to visually confirm an image of asubject and a picture composition without using the monitoring displayunit 2.

On the top of the digital camera 1, there are provided a shutter key 6at the right side of the top face, a guide panel 7 and various mode keys8.

When the shutter key 6 is manipulated or depressed at a timing ofphotographing the subject, a picture of the subject is taken followingan Auto Focus process and Auto Exposure process.

The guide panel 7 is a segment type of liquid crystal display panel, onwhich a currently selected photographing item, a battery level and aremaining memory amount, etc., are displayed.

The mode keys 8 are not only used to set or switch an operation mode tothe photographing mode or the reproducing mode, but also used to selecta couple photographing mode (as will be described hereafter) in thephotographing mode.

Though not shown in the drawings, the digital camera 1 is provided witha lens barrel, a flash system, an optical finder window, a self-timerindicator, etc, on its front face.

Now, referring to FIG. 2, an electronic circuit configuration built intothe digital camera 1 will be described.

In the digital camera 1, the photographing mode and the reproducing modeare alternatively set as the operation mode of the digital camera 1. Inthe digital camera 1, an optical lens system 12 is driven by a motor (M)11 to focus the camera lens and set the proper exposure. A solid-stateimaging device or CCD 13 is arranged along the optical axis of theoptical lens system 12, and is scanned by a timing signal generator (TG)14 and a vertical driver 15 in a monitoring state of the photographingmode. CCD 13 generates a frame of photoelectric transferred datacorresponding to an optical image focused every constant period.

The photoelectric transferred data (analog signal) with each of R, G, Bcolor components subjected a gain control process is transferred to asample-and-hold (S/H) circuit 16 to be sample-held, and further to ananalog-to-digital converter 17, where the data is converted into digitaldata. Then the digital data is supplied to a color processing circuit18, where the digital data is subjected to a color process including apixel interpolation process and the gamma correction process to generatea digital luminance signal Y and color-difference signals Cb, Cr.

A direct memory access controller (DMA controller) 19 receives thedigital luminance signal Y and the color-difference signals Cb, Cr, fromthe color processing circuit 18, and temporarily stores the receivedsignals in a built-in buffer by using a composite sync signal from thecolor processing circuit 18, an enable signal for enabling to write intoa memory, and a clock signal, and further DMA-transfers the signalsthrough DRAM interface (I/F) 20 to DRAM 21, which is used as a buffermemory. DRAM 21 stores image data that are obtained during thephotographing operation performed twice.

A control unit 22 controls the whole operation of the digital camera 1and includes CPU 221, ROM 222 for storing an operation program, RAM 223used as a work memory, a direction comparing unit 224 for comparingdesignated directions, an image angle correction unit 225 for correctingan angle of one of a first image data and a second image data, an imagecomposing unit 226 for combining the corrected image data and the otherimage data, and an image designating unit 227 for designating either ofthe first and the second image data. The control unit 22 reads out theluminance signal and the color-difference signals from DRAM 21 throughDRAM interface 20 and writes the luminance signal and thecolor-difference signal into VRAM 24 through VRAM controller 23.

A digital video encoder 25 reads out the luminance signal and thecolor-difference signals from VRAM 24 through VRAM controller 23 atfixed intervals, and generates a video signal based on these read outsignals to display on the monitoring display unit 2.

The monitoring display unit 2 displays the video signal supplied fromthe digital video encoder 15 in order to display an image based on imagedata which is obtained by CCD 13 at the time and sent through the VRAMcontroller 23.

The monitoring display unit 2 is integrally provided with a transparenttouch panel 26 on the top surface. The transparent touch panel 26 servesas a first direction designating unit and a second direction designatingunit. A touch panel controller 27 detects a manipulation made on thetouch panel 26, and outputs to the control unit 22 position-coordinatedata representing a position on the touch panel 27 where a user touches.

When the shutter key 6 among the plural keys included in a key inputunit 28 is manipulated at a timing of taking a picture with themonitoring display unit 2 displaying an image as a monitor image at thetime, a trigger signal is generated.

In response to the trigger signal, the control unit 22 DMA-transfers toDRAM 21 the luminance signal and the color-difference signals both forone frame which have been taken in from CCD 13 at the time, and thenimmediately closes a route between CCD 13 and DRAM 21 bringing DRAM 21into a storing state to keep data therein.

The control unit 22 reads out through DRAM interface 20 the luminancesignal and the color-difference signals for one frame in unit of afundamental block of 8 pixels in a vertical direction and 8 pixels in ahorizontal direction with respect to each of the components Y, Cb andCr, and writes these read out data onto JPEG (Joint Photographic ExpertsGroup) circuit 29, where these data are subjected to procedures such asADCT (Adaptive Discrete Cosine Transform) and Entropy coding or Huffmancoding for data compression.

The control unit 22 reads out code data forming one frame data file fromJPEG circuit 29, and writes the code data onto memory card 30. Thememory card 30 is a detachable nonvolatile recording-medium including aflash memory.

When the luminance signal and the color-difference signals for one framehave been subjected to the compression process and the compressed datahas been written onto the memory card 30, the control unit 22 opens theroute between CCD 13 and DRAM 21, again.

The key input unit 28 comprises the cross key 3, the decision key 4,mode keys 8 in addition to the shutter key 6, and a signal generated inresponse to the manipulation of these keys is directly sent to thecontrol unit 22.

Now, an operation of the first embodiment set forth above will bedescribed hereafter.

FIG. 3 is a flowchart illustrating a procedure to be performed in thephotographing mode, especially in the couple photographing mode. At StepA01, it is judged whether the couple photographing mode has been set ornot. If not, other photographing procedure is performed.

When it is determined at Step A01 that the couple photographing mode hasbeen set, the first photographing operation is performed at Step A02.Image data (first image data) obtained during the first photographingoperation is stored in DRAM 21. The first image data stored in the DRAM21 is displayed on the monitoring display unit 2.

FIG. 4A is a view illustrating by way of example images displayed basedon the first image data obtained during the first photographingoperation on the monitoring display unit 2. More specifically, an imageof a fixed subject “A” is displayed at the center of the display screenon the monitoring display unit 2, and an image of a person or a subject“B” is displayed on the right side of the display screen in the similarmanner as shown in FIG. 9A.

To prompt the user to designate the horizontal direction of the imagedisplayed on the monitoring display unit 2, a message saying, forexample, “Designate the horizontal direction of the image” is displayedover the images displayed on the display screen in an overlappingmanner. It may be possible to display a blinking arrow provisionallyrepresenting the horizontal direction of the image over the displayedimage.

At Step A03 the user draws a line on the tough panel 26 with his/herfinger to designate the horizontal direction of the image with the firstimage data displayed on the monitoring display unit 2. The informationrepresenting the designated horizontal direction of the image isassociated with the first image data obtained during the firstphotographing operation and stored in DRAM 21.

As shown in FIG. 4B, a solid arrow AR1 representing the horizontaldirection of the image is displayed in the designated direction over theimage.

Then, the second photographing operation is performed at Step A04. Sincethe first image data obtained during the first photographing operationis displayed in a semi-transparent state in a two third area on theright side of the display screen as shown in FIG. 4C, the secondphotographing operation is performed such that the real image of asubject and the semi-transparent image of the subject are overlapped.

The image data (second image data) obtained in the second photographingoperation is store in a different memory area in DRAM 21 from the memoryarea where the first image data obtained in the first photographingoperation has been stored, and the image data stored in DRAM 21 aredisplayed on the monitoring display unit 2.

While only the second image data obtained in the second photographingoperation is displayed, for example, in a one third area on the leftside of the display screen of the monitoring display unit 2, the userdesignates the horizontal direction of the displayed image on the touchpanel 26 at Step A05. The information representing the designatedhorizontal direction of the image is associated with the second imagedata obtained in the second photographing operation, and is stored inDRAM 2.

As shown in FIG. 4D, a solid arrow AR2 representing the designatedhorizontal direction of the image is displayed in the designateddirection on the monitoring display unit 2.

Then, it is judged at Step A06 whether or not the information isassociated with the image data stored in DRAM 21 to determine whether ornot the horizontal directions of the images have been designated withrespect to the two image data obtained in the two photographingoperations respectively.

Only when it is determined that the horizontal directions of the imageshave been designated, it is judged at Step A07 whether or not the twohorizontal directions of the images coincide with each other todetermine whether angles of the images should be corrected or not.

When it is determined at Step A07 that the two horizontal directions ofthe images do not coincide with each other and that the angle of theimage or a tilt of the image relative to the other image should becorrected, the angle correction procedure is performed at Step A08,where the second image data obtained in the second photographingoperation is rotated so as to make the horizontal direction of thesecond image meet with the first image, and then both the image data arecombined at step A09.

If the combined image data runs out of the frame of the image data, theportion running out of the frame is deleted at step A010. On thecontrary, if the combined image data can not fill in the frame of theimage data, the combined image data is subjected to a correctionprocedure at Step All to fill in the missing space with neighbor portionof the image data.

FIG. 5 is a view illustrating the first image data obtained in the firstphotographing mode, which is to be combined with the second image dataobtained in the second photographing mode shown in FIG. 4D, thehorizontal direction of which is amended so as to meet the horizontaldirection of the other image data. The portion running out of the frameand the missing portion, which generate in the angle correctionprocedure at Step A08 can be seen in FIG. 5. As described above, thehatched portions running out of the frame (a), (b) and (c) are deletedat Step A10, and the missing portions (d), (e) and (f) are filled in atStep All.

The combined image data resulted from the above mention amendments iscompressed in the JPEG circuit 29, and stored in the memory card 30 atStep A12. Then, the photographing procedure in the couple photographingmode finishes.

As described above, two image data, the horizontal directions of whichare different from each other can be combined into one image data givingno special unnatural feeling to a viewer by a simple manipulationperformed on the touch panel 26 integrally combined with the monitoringdisplay unit 2 by the user to designate the horizontal direction of theimage with his/her finger.

Modified First Embodiment of the Invention

A digital camera according to the modified first embodiment of theinvention will be described. In the digital camera, the horizontaldirection of an image is not designated on the touch panel 26 by theuser with his/her finger but designated with an angle sensor.

The external view of the digital camera of the modified first embodimentis the same as the first embodiment shown in FIG. 1. The digital camerahas the angle sensor in addition to those circuit elements illustratedin FIG. 3.

Now, an operation of the digital camera will be described, but furtherdescription of the similar processes as shown in the flowchart of FIG. 3are omitted.

After a first picture has been taken in the couple photographing mode,the angle sensor detects at Step A03 the angle of the digital camera 1used to take the first picture. Information representing the detectedcamera angle, which is used as indicating the horizontal direction ofthe first image data corresponding to the first picture, is associatedwith the first image data which has been obtained in the firstphotographing operation and stored in DRAM 21. On the monitoring displayunit 2, the solid arrow AR1 representing the detected camera angle maybe displayed over the image as shown in FIG. 4B, or may not bedisplayed.

After a second picture has been taken in the couple photographing mode,the angle sensor detects the angle of the digital camera 1 used to takethe second picture at Step A05. Information representing the detectedcamera angle, which is used as indicating the horizontal direction ofthe second image data corresponding to the second picture, is associatedwith the second image data which has been obtained in the second tphotographing operation and stored in DRAM 21. On the monitoring displayunit 2, the solid arrow AR1 representing the detected camera angle maybe displayed over the image as shown in FIG. 4D, or may not bedisplayed.

In the processes performed at Step A06 and thereafter, the informationrepresenting the camera angle are used as indicating the horizontaldirections of the first and second image data.

In the digital camera according to the modified first embodiment, theuser is not required to designate the horizontal direction of the imagedata on the touch panel 26 with his/her finger, and therefore images maybe combined by a simple manipulation. To obtain images to be combined,it is enough for the user to take pictures without paying attention tothe camera angle. Therefore, an easy-to-use digital camera is provided.The camera angle may be detected more precisely or more roughlydepending on the precision of the angle-sensor.

Second Embodiment of the Invention

A digital still camera (hereafter, “digital camera”) according to asecond embodiment of the present invention will be described withreference to the accompanying drawings.

The digital camera of the second embodiment has a similar external viewto the first embodiment shown in FIG. 1 and also has a similar circuitconfiguration to the first embodiment shown in FIG. 2. In the followingdescription, like reference numerals will be used to refer to like orcorresponding elements in the various figures, and the description anddrawings thereof will be omitted.

Now, an operation of the digital camera of the second embodiment will bedescribed with reference to the flowchart shown in FIG. 6.

At Step B01, it is judged whether the couple photographing mode has beenset or not. If not, another photographing procedure is performed.

When it is determined at Step B01 that the couple photographing mode hasbeen set, the first photographing operation is performed at Step B02.Image data (first image data) obtained during the first photographingoperation is stored in DRAM 21. The first image data stored in the DRAM21 is displayed on the monitoring display unit 2.

FIG. 4A is a view illustrating by way of example images displayed basedon the first image data obtained during the first photographingoperation on the monitoring display unit 2. More specifically, an imageof a fixed subject “A” is displayed at the center of the display screenon the monitoring display unit 2, and an image of a person or a subject“B” is displayed on the right side of the display screen in the similarmanner as shown in FIG. 9A.

To prompt the user to designate the horizontal direction of the imagedisplayed on the monitoring display unit 2, a message saying, forexample, Designate the horizontal direction of the image” over theimages displayed on the display screen in an overlapping manner. It maybe possible to display a blinking arrow provisionally representing thehorizontal direction of the image over the displayed image.

At Step B03 the user draws a line on the tough panel 26 with his/herfinger to designate the horizontal direction of the first image datadisplayed on the monitoring display unit 2. The information representingthe designated horizontal direction is associated with the first imagedata obtained during the first photographing operation and stored inDRAM 21.

As shown in FIG. 4B, a solid arrow AR1 representing the horizontaldirection is displayed in the designated direction over the image.

Then, the second photographing operation is performed at Step B04. Sincethe first image data obtained during the first photographing operationis displayed in a semi-transparent state in a two third area on theright side of the display screen as shown in FIG. 4C, the secondphotographing operation is performed such that the real image of asubject and the semi-transparent image of the subject are overlapped.

The second image data obtained in the second photographing operation isstore in a different memory area in DRAM 21 from the memory area wherethe first image data obtained in the first photographing operation hasbeen stored, and the image data stored in DRAM 21 are displayed on themonitoring display unit 2.

While only the second image data obtained in the second photographingoperation is displayed, for example, in a one third area on the leftside of the display screen of the monitoring display unit 2, the userdesignates on the touch panel 26 the horizontal direction of thedisplayed image at Step BO5. The information representing the designatedhorizontal direction of the image is associated with the second imagedata obtained in the second photographing operation, and is stored inDRAM 2.

As shown in FIG. 4E, a solid arrow AR2 representing the designatedhorizontal direction of the image is displayed in the designateddirection on the monitoring display unit 2.

Then, it is judged at Step B06 whether or not the information isassociated with the image data stored in DRAM 21 to determine whether ornot the horizontal directions of the images have been designatedrespectively with respect to the image data obtained in the twophotographing operations.

Only when it is determined that the horizontal directions of the imageshave been designated, it is judged at Step B07 whether or not the twohorizontal directions of the images coincide in direction with eachother to determine whether or not an angle of the image, or a tilt ofthe image relative to the other image should be corrected.

When it is determined at Step B07 that the two horizontal directions ofthe images do not coincide with each other and that the angle of theimage or the tilt of the image relative to the other image should becorrected, the angle correction procedure is performed at Step B08,where the second image data obtained in the second photographingoperation is rotated to make the two horizontal directions of the imagescoincide with each other.

The angle correction procedure is performed manually by the user. Forexample, a guide message saying “Designate an angle of the image using“→” key or ”←” key and decide the designated angle with the decisionkey” is displayed on the monitoring display unit 2 for receiving aninput from the key input unit 28.

Every time the “→” key or “←” key included in the cross key 3 in the keyinput unit 28 is manipulated, the angle of the second image data(obtained in the second photographing operation) displayed on themonitoring display unit 2 is adjusted at Step B08.

For example, every operation of the “←” key turns the second image databy 5 degrees in the counter clockwise direction and every operation ofthe “→” key turns by 5 degrees in the clockwise direction. Therefore,the angle of the second image data can be adjusted according to theuser's will on the monitoring display unit 2 by operation of thesedirection keys.

When the “→” key of the cross key3 is manipulated several times with thesolid arrow AR2 displayed over the second image data as shown in FIG.4E, the second image data is turned in the clockwise direction everytime the key is operated as set forth above.

FIG. 4F is a view illustrating the second image data which is adjustedin its direction such that the arrow AR3 representing the horizontaldirection of the second image data coincides with the arrow AR1representing the horizontal direction of the first image data shown inFIG. 4B.

When the decision key 4 provided at the center of the cross key 3 ismanipulated with the second image data adjusted in the angle as shown inFIG. 4F, the direction of the second image data is decided and the anglecorrection procedure finishes at Step B09.

At Step B10 an image composing process is performed to combine the firstimage data and the second image data with each other. The combined imagedata is subjected to the correcting process such that the portionsrunning out of the image frame are deleted at Step B11 and the missingportions are filled in at Step B12, as set forth above.

The resultant image data is compressed in JPEG circuit 29 and stored inthe memory card 30 at Step B13. Then, the photographing procedure isfinished.

As described above, when the horizontal direction of each of the imagedata are designated on the touch panel 26 integrally provided on themonitoring display unit 2, and the designated horizontal directions donot coincide with each other in direction, the user can adjust at willthe direction of one of the image data on the touch panel 26 such thatboth the horizontal directions of the image data coincide with eachother in direction, and therefore the resultant image data producing nounnatural feeling can be obtained.

Third Embodiment of the Invention

A digital camera according to a third embodiment of the invention willbe described with reference to the accompanying drawings.

The external view of the digital camera of the third embodiment issubstantially same as the first embodiment shown in FIG. 1, and thedigital camera also has substantially same circuit configuration shownin FIG. 2. In the following description, like reference numerals will beused to refer to like or corresponding elements in the various figures,and the further description and drawings thereof will be omitted.

Now, an operation of the digital camera of the third embodiment will bedescribed with reference to the flow chart shown in FIG. 7.

At Step C01, it is judged whether the couple photographing mode has beenset or not. If not, another photographing procedure is performed.

When it is determined at Step C01 that the couple photographing mode hasbeen set, the first photographing operation is performed to obtain animage for the center and right side portion of the display screen atStep C02. The first image data obtained in the first photographingoperation is stored in the DRAM 21 and displayed on the monitoringdisplay unit 2.

To prompt the user to designate the horizontal direction of the imagedisplayed on the monitoring display unit 2, a message saying, forexample, “Designate the horizontal direction of the image” over theimages displayed on the display screen in an overlapping manner. It maybe possible to display a blinking arrow provisionally representing thehorizontal direction of the image over the displayed image.

At Step C03 the user draws a line on the tough panel 26 with his/herfinger to designate the horizontal direction of the first image datadisplayed on the monitoring display unit 2. The information representingthe designated horizontal direction of the first image data isassociated with the first image data and stored in DRAM 21.

Thereafter, the second photographing operation is performed to obtainimaged data for the left one third area of the display screen at StepC04.

At this time, since the first image data is displayed in asemi-transparent state on the right two-thirds area of the displayscreen, the user can determine the camera angle in the secondphotographing operation so that the subject to be photographed willoccupy the left one-third area of the display screen.

The second image data obtained in the above mentioned way in the secondphotographing operation is stored in a different memory area in DRAM 21from the memory area where the first image data obtained in the firstphotographing operation has been stored, and the image data stored inDRAM 21 are displayed on the monitoring display unit 2.

The user designates the horizontal direction of the second image data onthe touch panel 26 with his/her finger at Step C05 while only the secondimage data is displayed in the left one third area of the monitoringdisplay unit 2.

The information representing the horizontal direction of the secondimage data is associated with the second image data in DRAM 21, and asolid arrow AR2 representing the horizontal direction of the secondimage data is displayed over the second image data displayed on themonitoring display unit 2.

Then, it is judged at Step C06 whether or not the information isassociated with the image data stored in DRAM 21 to determine whether ornot the horizontal directions of images have been designated withrespect to the image data obtained in the two photographing operationsrespectively.

Only when it is determined that the horizontal directions of the imageshave been designated, it is judged at Step C07 whether or not the twohorizontal directions of the images coincide in direction with eachother to determine whether or not an angle of the image or a tilt of theimage relative to the other image should be corrected.

When it is determined at Step C07 that the two horizontal directions ofthe images do not coincide with each other and that the angle of theimage should be corrected, it is judged at Step C08, whether or not theangle correction procedure is performed, where the second image dataobtained in the second photographing operation is rotated to make thetwo horizontal directions of the images meet with each other.

Judgment at Step C08 is performed as follows. For example, a guidemessage saying “Correct the angle of the image? YES→Decisionkey/NO→Shutter key” is displayed over the arrow representing thehorizontal direction of the second image data displayed on themonitoring display unit 2. Then, it is judged whether or not either ofthe Decision key and the Shutter key is manipulated to determine whetheror not the angle of the second image data is corrected with respect tothe first image data.

If the second image is to be adjusted in direction with respect to thefirst image data, an initially set condition is not changed. When theshutter key is manipulated, the initially set condition is changed atStep C09 so that the first image data is adjusted in direction withrespect to the second image data.

Then, the angle correction procedure is performed at Step C10 and one ofthe image data is turned so that the horizontal direction thereofcoincides with that of the other image data.

Then, the arranged image data and the other image data are combined atStep C11.

The portion of the combined image data which runs out of the frame isdeleted at Step C12, and the missing portion of the combined image datais filled in with data of the neighbor portion in at Step C13.

The resultant image data is compressed in JPEG circuit 29 and stored inthe memory card 30 at Step C14. Now, all the processes in the couplephotographing mode finish.

As described above, since the user can select the image data, thedirection or angle of which is to be arranged or corrected with respectto the other image data, the resultant image data is obtained with themore important image data not adjusted or corrected.

Forth Embodiment of the Invention

A digital camera according to a forth embodiment of the invention willbe described with reference to the accompanying drawings.

The external view of the digital camera of the third embodiment issubstantially same as the first embodiment shown in FIG. 1, and thedigital camera also has substantially same circuit configuration shownin FIG. 2. In the following description, like reference numerals will beused to refer to like or corresponding elements in the various figures,and the further description and drawings thereof will be omitted.

Now, an operation of the digital camera of the forth embodiment will bedescribed with reference to the flowchart shown in FIG. 8.

At Step D01, it is judged whether the couple photographing mode has beenset or not. If not, another photographing procedure is performed.

When it is determined at Step D01 that the couple photographing mode hasbeen set, the first photographing operation is performed to obtain animage to be displayed in the center and right side portion of thedisplay screen at Step D02. The first image data obtained in the firstphotographing operation is stored in the DRAM 21 and displayed on themonitoring display unit 2.

To prompt the user to designate the horizontal direction of the imagedisplayed on the monitoring display unit 2, a message saying, forexample, “Designate the horizontal direction of the image” over theimages displayed on the display screen in an overlapping manner. It maybe possible to display a blinking arrow provisionally representing thehorizontal direction of the image over the displayed image.

At Step D03 the user draws a line on the tough panel 26 with his/herfinger to designate the horizontal direction of the first image datadisplayed on the monitoring display unit 2. The information representingthe designated horizontal direction of the first image data isassociated with the first image data and stored in DRAM 21.

Thereafter, the second photographing operation is performed to obtainimaged data to be displayed in the left one third area of the displayscreen at Step D04.

At this time, since the first image data is displayed in asemi-transparent state on the right two third area of the displayscreen, the user can determine the camera angle in the secondphotographing operation so that the subject to be photographed willoccupy the left one third area of the display screen.

The second image data obtained in the above mentioned way in the secondphotographing operation is stored in a different memory area in DRAM 21from the memory area where the first image data obtained in the firstphotographing operation has been stored, and the image data stored inDRAM 21 are displayed on the monitoring display unit 2.

The user designates the horizontal direction of the second image data onthe touch panel 26 with his/her finger at Step DO5 while only the secondimage data is displayed in the left one third area of the monitoringdisplay unit 2.

The information representing the horizontal direction of the secondimage data is associated with the second image data in DRAM 21, and asolid arrow AR2 representing the horizontal direction of the secondimage data is displayed over the second image data displayed on themonitoring display unit 2.

Then, it is judged at Step C06 whether or not the information isassociated with the image data stored in DRAM 21 to determine whether ornot the horizontal directions of images have been designated withrespect to the image data obtained in the two photographing operationsrespectively.

Only when it is determined that the horizontal directions of the imageshave been designated, it is judged at Step D07 whether or not the twohorizontal directions of the images coincide in direction with eachother to determine whether not angles of the images should be corrected.

When it is determined at Step D07 that the two horizontal directions ofthe images do not coincide with each other and that the angles of theimages should be corrected, it is judged at Step D08, whether or not theangle correction procedure is performed, where the second image dataobtained in the second photographing operation is rotated to make thetwo horizontal directions of the images meet with each other.

Judgment at Step D08 is performed as follows. For example, a guidemessage saying “Correct the angle of the image? YES→Decisionkey/NO→Shutter key” is displayed over the arrow representing thehorizontal direction of the second image data displayed on themonitoring display unit 2. Then, it is judged whether or not either ofthe Decision key and the Shutter key is manipulated to determine whetheror not the angle of the second image data or a tilt of the image datarelative to the other image data is corrected with respect to the firstimage data.

If the second imaged is adjusted in direction with respect to the firstimage data, an initially set condition is not changed. But when theshutter key is manipulated, the initially set condition is changed atStep D09 so that the first image data is adjusted in direction withrespect to the second image data.

Then, the angle correction procedure is performed at Step D10 and one ofthe image data is turned so that the horizontal direction thereofcoincides with that of the other image data.

The angle correction procedure is performed manually by the user. Forexample, a guide message saying “Designate an angle of the image using“→” key or “←” key and decide the designated angle with the decisionkey” is displayed on the monitoring display unit for receiving an inputfrom the key input unit 28.

Every time the “→” key or “←” key included in the cross key 3 in the keyinput unit 28 is manipulated, the angle of the image data to becorrected and displayed on the monitoring display unit 2 is corrected atStep D08.

For example, every operation of the “←” key turns the second image databy 5 degrees in the counter clockwise direction and every operation ofthe “→” key turns by 5 degrees in the clockwise direction. Therefore,the angle of the image data can be corrected according to the user'swill on the monitoring display unit 2 by operation of these directionkeys.

When the decision key 4 provided at the center of the cross key 3 ismanipulated with the image data adjusted in the angle, the direction ofthe image data is decided finally and the angle correction procedurefinishes at Step D11.

At Step D12 an image composing process is performed to combine the firstimage data and the second image data with each other.

The combined image data is subjected to the correcting process such thatthe portions running out of the image frame are deleted at Step D13 andthe missing portions are filled in with data of the neighbor portion atStep D14.

The resultant image data is compressed in JPEG circuit 29 and stored inthe memory card 30 at Step D15. Then, the photographing procedure isfinished.

As described above, when the horizontal direction of each of the imagedata are designated on the touch panel 26 integrally provided on themonitoring display unit 2, and the designated horizontal directions donot coincide with each other in direction, the user can select the imagedata, the direction or angle of which is to be adjusted or correctedwith respect to the other image data, and can adjust or correct at willthe direction of the selected image data on the touch panel 26 such thatboth the horizontal directions of the image data coincide with eachother in direction.

Therefore, the resultant image data producing no unnatural feeling canbe obtained with the more important image data not adjusted orcorrected.

In the first embodiment through the forth embodiment of the inventionset forth above, a line is drown over the displayed image by the userwith his/her finger to designate the horizontal direction of the images,but another line may be drawn to designate a vertical direction of theimage in place of the horizontal direction.

Another method may be employed to determine the direction of image data.In this method, arrows radiating in eight or sixteen directions aredisplayed over the displayed image, and the user selects one of thearrows, for instance, an arrow extending in the vertical direction onthe touch panel to designate the top of the image.

It may be also possible to designate the horizontal direction of imagedata to be combined using the direction key.

If the cross key 3 has skew keys in addition to or between theupward-direction key, the downward-direction key, the leftward-directionkey, the rightward-direction key and the decision key, eight directionsmay be designated using such cross key 3. Using the cross key, the usercan designate the direction of the image data to be combined.

In the embodiments set forth above, the image data to be displayed inthe right two-thirds area of the display screen is obtained in the firstphotographing operation and the image data for the remaining left onethird area of the display screen is obtained in the second photographingoperation. But it may be possible to obtain image data for a right halfarea of the display screen in the first photographing operation andimage data for the left half area in the second photographing operation.Further, the display area for the first and second image data may bedivided in various ratios, for example, the one third area of thedisplay screen area may be assigned for the first image data and the twothird area for the second image data.

In the second and forth embodiments, the angle of the image data isadjusted by the user's manipulation of the key, but the angle of theimage data may be adjusted fine by the key manipulation after the angleof the image data has been automatically adjusted so that the horizontaldirections of the both image data coincide with each other.

It may be applied to the second through forth embodiments to use theangle sensor to detect the angle of the digital camera to designate thehorizontal directions of the image data, as described in the modifiedfirst embodiment.

Further modification and variation can be made to the disclosedembodiments without departing from the subject and spirit of theinvention as defined in the following claims. Such modification andvariations, as included within the scope of these claims, are meant tobe considered part of the invention as described.

1. An image pickup apparatus comprising: a storage (21) for storingfirst image data and second image data obtained respectively in a firstphotographing operation and a second photographing operation; a firstdirection-designating unit (26) for designating a direction for thefirst image data stored in the storage; a second direction-designatingunit (26) for designating a direction for the second image data storedin the storage; a direction-comparing unit (224) for comparing thedirections designated respectively for the first image data and thesecond image data by the first and the second direction-designatingunit; an image-angle correcting unit (225) for adjusting a tilt ofeither of the first and the second image data depending on a result ofthe comparison made by the direction-comparing unit so that thedirection of the adjusted image data coincides with the direction of theother image data; and an image composing unit (226) for combining theimage data adjusted by the image-angle correcting unit and the otherimage data.
 2. The image pickup apparatus according to claim 1, whereininformation of the direction for the first image data designated by thefirst direction-designating unit is associated with the first image dataand stored in the storage, and information of the direction for thesecond image data designated by the second direction-designating unit isassociated with the second image data and is stored in the storage. 3.The image pickup apparatus according to claim 1, further comprising: animage designating unit (227) for designating either of the first imagedata and the second image data, wherein the image-angle correcting unitcorrects the tilt of the image data designated by the image designatingunit so that the direction of the designated image data coincides withthat of the other image data.
 4. The image pickup apparatus according toclaim 1, wherein the image-angle correcting unit corrects the tilt ofeither of the first image data and the second image data by an arbitraryangle.
 5. The image pickup apparatus according to claim 1, wherein theimage composing unit combines the image data, the tilt of which iscorrected with the other image data, and deletes a portion of thecombined image data which runs out of a predetermined frame and fills ina portion of the combined image data missing from the frame.
 6. Theimage pickup apparatus according to claim 1, wherein the first and thesecond direction-designating unit comprise a touch panel and designatethe direction using coordinates which represent positions on the touchpanel where a user touches.
 7. The image pickup apparatus according toclaim 1, wherein the first and the second direction-designating unitcomprise an angle sensor for detecting an angle and designate adirection based on the detected angle.
 8. The image pickup apparatusaccording to claim 1, wherein the first and the seconddirection-designating unit comprise key buttons and designate adirection based on a direction of the depressed key button.
 9. Aphotographing method comprising the steps of: a) storing in a storagefirst image data and second image data obtained respectively in a firstphotographing operation and a second photographing operation (A02, A04);b) designating a direction for the first image data stored in thestorage (A03); c) designating a direction for the second image datastored in the storage (A05); d) comparing the directions designatedrespectively for the first image data and the second image data (A06,A07); e) adjusting a tilt of either of the first image data and thesecond image data depending on a result of the comparison so that thedirection of the adjusted image data coincides with the direction of theother image data (A08); and f) combining the adjusted image data and theother image data (A09).
 10. The photographing method according to claim9, wherein information of the designated direction for the first imagedata is associated with the first image data and stored in the storage,and information of the designated direction for the second image data isassociated with the second image data and is stored in the storage. 11.The photographing method according to claim 9, further comprising thestep of: g) designating either of the first image data and the secondimage data, wherein the tilt of the designated image data is correctedso that the direction of the designated image data coincides with thatof the other image data (C08, C09).
 12. The photographing methodaccording to claim 9, wherein the tilt of either of the first image dataand the second image data is corrected by an arbitrary angle.
 13. Thephotographing method according to claim 9, wherein the image data whosetilt is corrected is combined with the other image data, and a portionof the combined image data which runs out of a predetermined frame isdeleted and a portion of the combined image data missing from the frameis filled in.
 14. A storage medium recording a photographing method,which method comprises the steps of: a) storing in a storage first imagedata and second image data obtained respectively in a firstphotographing operation and a second photographing operation (A02, A04);b) designating a direction for the first image data stored in thestorage (A03); c) designating a direction for the second image datastored in the storage (A05); d) comparing the directions designatedrespectively for the first image data and the second image data (A06,A07); e) adjusting a tilt of either of the first image data and thesecond image data depending on a result of the comparison so that thedirection of the image data to be adjusted coincides with the directionof the other image data (A08); and f) combining the adjusted image dataand the other image data (A09).
 15. The storage medium recording thephotographing method according to claim 14, in which method informationof the designated direction for the first image data is associated withthe first image data and stored in the storage, and information of thedesignated direction for the second image data is associated with thesecond image data and is stored in the storage.
 16. The storage mediumrecording the photographing method according to claim 14, which methodfurther comprises the step of: g) designating either of the first imagedata and the second image data, wherein the tilt of the designated imagedata is corrected so that the direction of the designated image datacoincides with that of the other image data (C08, C09).
 17. The storagemedium recording the photographing method according to claim 14, inwhich method the tilt of either of the first image data and the secondimage data is corrected by an arbitrary angle.
 18. The storage mediumrecording the photographing method according to claim 14, in whichmethod the image data whose tilt is corrected is combined with the otherimage data, and a portion of the combined image data which runs out of apredetermined frame is deleted and a portion of the combined image datamissing from the frame is filled in.